Cold Job Demo
Here's a step-by-step demonstration of how to create and manage a cold data archiving job in the platform:
1. Add Data Source and File Source
Add Data Source
- Go to the "Configuration Management" menu and select "Data Source Management".
- Click the blue "Add" button and fill in the required information for the data source. Test the connection and save it if the test is successful.
Add File Source
- Go to the "Configuration Management" menu and select "Target Source Management".
- Click on "Cold Data File Source" and then click the blue "Add" button.
- Fill in the necessary information related to cold data archiving and save the file source.
2. Assign Permissions
After adding the data source and file source, administrators need to assign database permissions in the "User Management" page under "System Management".
3. Create a Cold Job
- Go to the "Configuration Management" menu and select "Table Job Configuration".
- Click the blue "Add" button in the "Cold Data Table Job" section.
- Fill in the required information, including selecting the data source and file source.
- Optionally, configure data consistency validation and choose the data handling method after synchronization.
- Save the job configuration.
4. Create a Task
- Click on the "Task Configuration" menu and then "Cold Data Task Configuration".
- Click the blue "Add" button to create a new task configuration.
- Fill in the necessary details according to your requirements.
- Optionally, configure execution mode, task timeout, retry attempts, and notification settings.
- Choose the notification strategy and add email addresses for alerts.
- Save the task configuration.
Add Table Jobs to the Task
- Click "Add Job" to associate table jobs with the created task.
- Select the desired table jobs and click "Confirm" to add them to the task.
Admin Approval
- After configuring the task, an administrator can review and approve it if needed.
- The task is ready for execution after approval.
5. Task Scheduling
- Navigate to the "Task Management" menu and select "Task Scheduling".
- Monitor the status of the task in this section.
- Click "Execute Now" to immediately execute the task.
6. Task Monitoring
- In the task scheduling section, you can monitor the execution status of the task.
- Visit the "Task Monitoring (Cold)" page to view the detailed execution status of the task.
By following these steps, you can successfully create, configure, and manage cold data archiving jobs in the platform. This allows you to archive data from various sources and monitor the execution of tasks for data consistency and reliability.